Papers with re-usage and composition of the
Combining Parameter-efficient Modules for Task-level Generalisation (2023.eacl-main)
Copied to clipboard
| Challenge: | A modular design encourages neural models to disentangle and recombine different facets of knowledge to generalise more systematically to new tasks. |
| Approach: | They propose a modular neural network where a subset of latent skills is associated with a parameter-efficient model adapter. |
| Outcome: | The proposed model improves sample efficiency and few-shot generalisation in supervised learning compared to baselines. |